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/J^ , Abstract. In a recent paper, K. Keller has given a characteriza- 

-H- ' tion of the Kolmogorov-Sinai entropy of a discrete-time measure- 

preserving dynamical system on the base of an increasing sequence 
_J ' of special partitions. These partitions are constructed from order 

f^S i relations obtained via a given real- valued random vector, which 

Cn ' can be interpreted as a collection of observables on the system and 

is assumed to separate points of it. In the present paper we relax 
the separation condition in order to generalize the given charac- 
terization of Kolmogorov-Sinai entropy, providing a statement on 
equivalence of er- algebras. On its base we show that in the case that 
C^ i a dynamical system is living on an m-dimensional smooth mani- 

fold and the underlying measure is Lebesgue absolute continuous, 
the set of smooth random vectors of dimension n > m with given 
characterization of Kolmogorov-Sinai entropy is large in a certain 
sense. 
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2 kolmogorov-sinai entropy 

1. Introduction 

1.1. Motivation. Kolmogorov- Sinai entropy of a /i-preserving map T 
on a probability space (Q, J 7 , /i) is an important concept in dynamical 
systems and ergodic theory. It is defined as the supremum of the en- 
tropy rates h^iT^A) of all finite partitions A C J 7 of Q, which usually 
makes its determination complicated. In some exceptional cases, a gen- 
erating partition is known allowing to determine the Kolmogorov-Sinai 
entropy on the base of only this partition (see, e.g., [18]), but generally 
one has to take into account an infinite collection of finite partitions. 

Here the question arises whether such a collection is given in a nat- 
ural way. An interesting approach leading to some kind of natural 
partitioning was given by introducing the concept of permutation en- 
tropy by C. Bandt and B. Pompe [5] (see also [2]). This quantity 
is based on only considering the order structure of a system and has 
been applied to the analysis of long time series, for example, of elec- 
troencephalograms and cardiograms. The point that Kolmogorov-Sinai 
entropy and permutation entropy coincide for piecewise monotone in- 
terval maps, as shown by C. Bandt, G. Keller and B. Pompe [4], gives 
rise to the question if both entropies are equivalent for a broader class 
of dynamical systems. 

Remark. J. Amigo, M. Kennel, and L. Kocarev [3, 1] have shown 
equivalence of Kolmogorov-Sinai entropy to a modified concept of per- 
mutation entropy which is structurally similar to that of Kolmogorov- 
Sinai entropy. 

K. Keller and M. Sinn [13, 12, 10] have discussed the question of coin- 
cidence of permutation entropy and Kolmogorov-Sinai entropy in a gen- 
eral context, in particular by considering dynamical systems equipped 
with a random vector 

e = (£i,&,- ■-,£«) -m^w 1 . 

Here the idea is to measure complexity of a system via the 'observables' 
£i, £2, • • • 1 £n- For given d G N, the set f2 is partitioned into sets of points 
u G Q for which all vectors 

(Ci(u),Ci(T(u)),...,^(T d (u)), i = l,2,...,d 

are of the same order type. The larger d the more information on the 
system is given by the partition obtained in this way and called V d ' 
here. The permutation entropy is defined as the upper limit of the 
Shannon entropy of the V d ' relative to d for d — > 00. 
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It has been shown that under certain 'separation' conditions on 
(T, 6) it holds 

(1) K s (T)=limh»(T,P®> T ), 

and that the permutation entropy with respect to £ is not less than 
the Kolmogorov- Sinai entropy. Under validity of (1), the problem of 
equality of both entropies is reduced to a combinatorial problem related 
to the problem of equality of permutation entropy and the right side of 

(1) (see K. Keller, A. Unakafov and V. Unakafova [11]). Therefore, it 
is of some particular interest to find sufficient conditions for (1) being 
as general as possible. This is the central aim of the present paper. 

1.2. An outline. The main ingredient for showing (1) is the equiva- 
lence of two cr-algebras with respect to \i in the case of ergodic T: 

(2) £ e < T ^, 

where S 0,T is the u-algebra generated by |Jd=L ^V ■ For making 
apparent the structural arguments, consider the third u-algebra cr({0o 
T k }k>o), generated by and their 'shifts' 0oT, 0oT 2 , . . .. The central 
statement of this paper is that for ergodic T 

(3) a({0oT fc } fc >o)c£ 6 ' r 
Since 

(4) £ > T Ca({0oT fc } fc > o ), 

which can be verified by standard arguments, this provides that in the 
ergodic case 

(5) a({0oT fc } fc > o )=.F 

is equivalent to (2), hence sufficient for (1). The second ingredient for 
showing (1) is ergodic decomposition. 

Condition (5) is substantially weaker than the corresponding state- 
ment in [10], allowing generalizations of consequences of the main state- 
ment therein. In particular, the application of embedding theory (com- 
pare [16] and [17]) is more apparent from the viewpoint of our paper, 
but it also turns out that the full power of this theory is not needed. In 
this paper we will show that the set of smooth maps satisfying (1) 
which are not too far from being injective is large in a certain sense. 
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1.3. Organization of the paper. In Section 2 we give the basic def- 
initions and formulate the main statements of the paper, which are 
Theorems 2.5 and 2.13. 

Section 3 is mainly devoted to the proof of Theorem 2.5. Here, the 
ideas given in [10] are lifted to a sufficiently abstract level, in order to 
extract the general structures and to find the necessary assumptions 
under which (1) is satisfied. 

The proof of Theorem 2.13 is given in Section 4. As a preparation 
of the proof, we recall some definitions and statements from (differen- 
tial) topology, as for example the Multijets transversality theorem, and 
deduce some statement being interesting from their own right. 

2. Preliminaries and formulation of main results 

2.1. Kolmogorov-Sinai entropy. Let Q be a non-empty set. For 
a family of subsets A = {AA-^i of fi, denote by cr(A) the cr-algebra 
generated by A. 

If G : Q — > X is a map into some topological space X, then we 
denote by cr(G) the a-algebra on Q of inverse images of the cr-algebra 
B(X) of Borel subsets of X under 0. 

If A = {Ai\ i( zi and B = {Bj}j e j are two partitions of Q, then we 
define the new partition A V B of Q by 

AvB = {A i nB j \A i e A, Bj e B}. 

We write 

A<B 

if each element A G A is a finite union of some elements of B. 

Let J 7 be a a-algebra of subsets of Q and /i be a measure on J- '. 
Denote by II (J 7 ) the set of all finite partitions A = {Ai, . . . , A n } of Q 

such that Ai G T for each % — 1, n. Then the entropy of A G II (J 7 ) 

with respect to /i is defined by the formula 

v. 
H,(A) = -Y,^ l )\og f i(A i ). 

i=l 

Further, let T : Q — > Q be a measurable map. Denote by T~ l A the 
partition of Q consisting of all inverse images of elements of A: 

T- 1 A = {T-\A l ),...,T-\A n )}. 

For each k > 1 define the partition 

Tk(A) =AV T- l A V • • • T'^A. 

Evidently, 

nfaiA)) = r k+1 (A). 
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Definition 2.1. Let T : Q — > Q be a measurable map. Then its 
Kolmogorov- Sinai entropy is defined by the formula: 

h« s (T)= sup lim \H,{r k {A))- 

Though the computation of Kolmogorov-Sinai entropy requires con- 
sidering all finite partition of Q belonging to n(J-"), the following lemma 
shows that this entropy can be obtained from certain increasing se- 
quences of finite partitions. 

Lemma 2.2. [18, Lemma 4.2] Let {Ad}d>i be a sequence of finite par- 
titions of J 7 such that 

A X ^A 2 < <A d <--- 

and a ({A d }Zi) = T. Then h« s (T) = lim lim {H ^(Ad)) ■ 

d— s-oo k— >oo 

o 

If A, B C T are two sub- a- algebras, we write B C A if for each B G B 
there exists some A G A such that fi(B A A) = 0. Correspondingly, 

we write B = A if A C B and B C A. 

2.2. Ordinal partition C^ of M d+1 . For a permutation 7r = (i , . . . , id) 
of a set {0, . . . , d} define the subset O n of R. d by the following rule: the 
point (xo, • • • ,Xd) G M d+1 belongs to Oi 0t ,,, t i d whenever 

^i() — *1 — — *d 

and if x, T = Xj T+1 for some r G {0, . . . , d — 1} then 

Remark. Notice that each vector x = (xq, . . . ,Xd) G M d+1 can be 
regarded as a (d + l)-tuple of pairs of numbers: 

(6) (Oo,0), (xi,l), ..., (x d ,d)). 

This set can be uniquely lexicographically ordered in a decreasing man- 
ner: at first we sort them by values of Xj, and then by their indices i. 
Thus we can associate to x a unique permutation n of indexes {0, . . . , d} 
which sorts the above set of pairs (6). Then O v consists of all x G IR d+1 
that can be sorted by the same permutation n. 

It is easy to see that the following family of sets 

Od = {O n | -it = (z , . . . ,i d ) is a permutation of {0, ... , d}} 

is a partition of M. d+l . 
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2.3. Ordinal partition of Q. Now let O be a set, T : Q — > Q and 
( : O -> 1 be a function. Then for each d G N we can define the 
following map 

A d = ^ZoT,...,£oT d ):n-+R d+1 . 

Define the partition V d ' = {Pj' T } of f2, where 

Pl> T = A^(O n ), 

and ix runs over all permutations of the set {0, . . . , d}. Thus P|' is 
just the inverse image of the partition Od of M. d+1 under the map A<j. 

Remark. Notice that each set P%' , ix = (io,---,id) consists of all 
u G Q such that 

(or(w) > (or(w) > ■•■ > ^oT id (u), 

and if £ o T^{oj) = £ o T^+ 1 {oj), then i T > i T+1 . 

Remark. The partition V d ' can also be described in the following 
way. For each pair (i,j) such that < i < j < d define the partition 
of Q by two sets: 

B% l = {uen\SoT i (u>)<SoT'(u)}, 

Rf = {u G n I £ o T\u) > £ o T j {u)}. 
Then it is easy to see that 

(8) V" d T = \/ Ri *- 

#je{o,...,d} 

Definition 2.3. The cr-algebra 

is called the ordinal cr-algebra of Q for (£, T). 

More generally, let 6 = (£i, . . . , £ n ) : f2 — > IR n be a map. Then we 
define the partition 



pr=yi- T . d>i. 



%=\ 



and the cr-algebra 

S e '^=<r({^ T }L)="({ S& ' T }rJ 

which we call the ordinal cr-algebra of Q for (G, T). 
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Suppose J 7 is a a-algebra of subsets of Q such that T : Q — > Q is 
J r -J r -nieasurable and O : Q — > M. n is J-"-S(IR n )-measurable. Then it is 
obvious that 

The following lemma easily follows from (7) and (8) and we left it to 
the reader. 

Lemma 2.4. £ e < r C a({0 o T fc } fc > ) . □ 

2.4. Main results. The following theorem gives sufficient conditions 
for the validity of (1). 

Theorem 2.5. Let (Q, J 7 , /i) be a probability space, T : Q — > Q be a 
measurable [i-invariant transformation, and = (£i, . . . , £ n ) : Q — > ~R n 
be a measurable map such that cr({0 oT'J^o) = J- '. Suppose also that 
one of the following conditions holds true: either 

(a) T is ergodic, or 

(b) T is not ergodic, however fi can be embedded into some compact 
metrizable space so that J 7 = B(Q). 

Then 



h« s (T) = Jim lim \Hjr k {P c 



0,T^ 
d 



We will now recall the notions of residuality and prevalence being 
respectively a topological and a measure-theoretic formalization of the 
expression "almost every". 

A subset A of a topological space is residual if A is an intersection of 
countably many sets with dense interiors. A Baire space is a topological 
space in which every residual subset is dense. Every complete metric 
space is Baire. 

Definition 2.6. Let V be a linear vector space over R or C. A finite- 
dimensional subspace P C V is called a probe for a set A C V if for 
each v & V the intersection P fl [(V \ A) + v] has Lebesgue measure 
zero in P. 

Suppose now that V is a topological vector space, i.e. that it has a 
topology in which addition of vectors and multiplication by scalars are 
continuous operations. 

Definition 2.7. Let /i be a nonnegative measure on the c-algebra 
B(V), and S C V be a Borel subset. Then /i is said to be transverse 
to S 1 if the following two conditions hold: 

(i) There exists a compact subset U C V such that < n{U) < oo. 
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(ii) fi(S + v) = for every v G V, where S + v = {s + v \ s G S} is 
the translation of S by the vector v. 

Definition 2.8. A subset A C V is called prevalent if its complement 
V^ \ A is contained in some Borel set admitting a transverse measure. 

The following lemma summarizes some properties of prevalent sets 
obtained in [9]. 

Lemma 2.9. [9] Suppose V admits a complete metric. Let also A G V 
be a subset. 

1) If A is prevalent, then V \ A is nowhere dense. 

2) If dimy < oo ; then A is prevalent if and only if V \ A has 
Lebesgue measure zero. 

3) If dim V = oo and V \ A is compact, then A is prevalent. 

4) // A admits a probe, then A is prevalent. □ 

In general classes of residual and prevalent subsets of a complete 
metric space V are distinct and no one of them contains the other. 

Let Q and X be smooth manifolds and r = 0, 1, . . . , oo. Then the 
space C r (Q,X) admits two natural topologies weak, Cyy, and strong, 
Cg. The following lemma collects some information about these topolo- 
gies, see e.g. [8, Chapter 2] and [6, Chapter II, §3]. 

Lemma 2.10. 1) Topology C s is finer than Cfa. IfVt is compact, then 
these topologies coincide. 

2) C r (Q,X) is a Baire space with respect to each of the topologies 
C^y and C s . 

3) C r (Q, X) admits a complete metric with respect to the weak topol- 
ogy c r w . 

4) Suppose X = M. n , so the space C r (Q, MJ 1 ) has a natural structure of 
a linear space. Then C r (Q, ~R n ) is a topological vector space with respect 
to the weak topology C^. However, ifVt is non-compact, then C r (Q, M. n ) 
is not a topological vector space with respect to the strong topology 
C r s , since the multiplication by scalars is not continuous. □ 

Again let Q be a smooth manifold of dimension m. 

Definition 2.11. A subset D C Q has measure zero if for any local 
chart (U, tp) on Q, where U C Q is an open subset and ip : U — > M m is 
a smooth embedding, the set <p(D D U) has Lebesgue measure zero in 



Definition 2.12. Let \x be a measure on B(Q). We will say that \x 
is Lebesgue absolute continuous if /x(-D) = for any subset D C Q of 
measure zero in the sense of Definition 2.11. 



KOLMOGOROV-SINAI ENTROPY 9 

Remark. We can reformulate Definition 2.12 as follows. Let A be a 
Lebesgue measure on R m and (U, p) be a local chart on Q. Since p 
is an embedding, we can define the induced measure <p*(\) on B(U) 
by (p*(\)(A) = X(A) for all A G B{U). Then /i is Lebesgue absolute 
continuous if for any local chart (U, p) the restriction of ft to B(U) is 
absolute continuous with respect to y3*(A). 

Our second result shows that the set of maps O for which (1) holds 
is "large". 

Theorem 2.13. Let Q be a smooth manifold of dimension m, /i be 
a measure on B(Q), T : Q —y Q be a measurable \x-invariant trans- 
formation. Suppose fi is Lebesgue absolute continuous in the sense of 
Definition 2.12. Let V be the set of all maps 6 G C°°(f2, R n ) for which 

holds. If n > m, then V is residual in C°°(r2,IR ?1 ) with respect to 
strong topology CJ° , and prevalent with respect to the weak topology 

3. Separation via ct-algebras 

3.1. Properties of distribution functions. Let (Q, J 7 , u) be a prob- 
ability space and ^ : Q — y R be a measurable function. Let also 
F : R — y [0, 1] be the distribution function of £, i.e. 

F(a) = h{uj | £(u) < a} = /i(^ _1 (— oo, a]) 

It is well-known that F is non-decreasing, right continuous, and that 

lim F(a) = 0, lim F(a) = 1. 

a— >— oo a— >+oo 

The latter justifies that F can also be considered as a function from 
[— oo, +oo] into [0,1]. 

For further considerations it will be convenient to keep in mind the 
following commutative diagram: 

(10) 



which implies that Fo£ is J r -£>(R)-measurable and so it holds a(Fo^) c 
T. 

For each a G R define the following two elements of [—00,00]: 

a, = inf(F _1 F(a)), a* = sup(F" 1 F(a)). 
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Moreover, let 

C a = (-00, a). 

Lemma 3.1. Let a G R. T/ien t/ie following statements hold true. 

(1) F~ 1 F(a) coincides either with [a*, a*) or with [a*, a*]. 

(2) F- 1 F(C a J = C a ,. 

(3) //a* < a, i/ien 

F- 1 F(C a ) = C Q , UF~ 1 F(a), 

so F~ l F(C a ) either equals (— oo, a*) or (— oo, a*]. Moreover, let 

Z = F- l F(C a ) \ C a . 

Then ^-\Z)) = 0. 

Proof. (1) Evidently, F~ 1 F(o) C [a*, a*]. 

We will now prove that [a*, a*) C F~ 1 F(a). By definition of infimum 
and supremum of the set F~ 1 F(a) there are two sequences {xj}, {y^} C 
F- 1 F(a) such that 

a* < • ■ • < Xi+i < Xi < ■ ■ ■ < Xi < yi < ■ ■ ■ < yi < y i+i < ■ ■ ■ < a*, 

lim Xi = a* and lim y^ = a*. 

i— >oo i— s-oo 

Since F is nondecreasing and F(xi) = F(yi) = F(a) for all i, it 
follows that F is constant on each segment [xj, y^, and so 

(a*, a*) = \J[xi, yi ] C F-'Fia). 

i 

Moreover, from right- continuity of F we obtain that F(a*) = lim F(xi) - 
F(a), hence {a*, a*) C F~ 1 F(a). 

(2) The inclusion C a>( C F~ 1 F(C at ) is evident. Suppose that there 
exists some 

* G F-^OJ \ Co.. 
This means that 
(i) t > a*, and 

(ii) F(t) G F(C a J, i.e. F(t) = F(s) for some s < a*, 
Thus s < a* < t. Since F is non-decreasing, 

F(s) = F(o.) ( => F(o) = F(t), 

that is s G F~ l F(a), and therefore a* < s, contradicting the assump- 
tion. Thus F" 1 F(C a J = C a „. 

(3) Since a* < a, F(a*) = F(a), and F is non-decreasing, it follows 
that 

F(C a ) = F((-oo,0) UF([a„a)) = F(C a J U {F(a)}, 
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hence 

F- l F(C a ) = F- l (F(C a JU{F(a)}) 

= F~ l F(C a ,) U F^F(a) ( = } C a , U F^F(a). 



It follows that Z either equals [a, a*] or [a, a*). Suppose Z = [a, a*], 
then 

H{C\Z)) = MrV, a*]) = Kr\-oo, a*}) - Mf^-oo, a)) 

= F(o*)- lim At(£ _1 (-oo,ri) 

t—>a 

= F(a) - lim F(t) = F(a) - lim F(a) = 

tS(a*,a) <G(a*,a) 

Now, let Z = [a, a*). Then similarly, 

KC\Z)) = fiiC'ia, a*)) = rtCH-oo, a*)) - KC 1 (-<*>, «)) 

= lim fi(C l (-oo,s])- lim yu(^ _1 (-oo,t]) 

s£(o,,a*) ie(<i*,<x) 

= lim F(s) - lim F(t) = lim F(a) - lim F(a) = 0. 

s— >a* t^ra s— >a* t-+a 

sg(a*,a*) te(a*,a) sG(a»,a*) tG(a*,a) 

Lemma is completed. □ 

Lemma 3.2. a(F o £) = a(£). 

Proof. It is easy to see that a(F o £) c <x(£). Indeed, let A G a(F o £), 
so 

A=(FoO" 1 (S) = r 1 i ? - 1 (5) 
for some B G B([0, 1]). But F~ 1 {B) G B(R), hence A G a(£). 

o 

Now we will show that ct(F o £) d cr(0- F° r eac ^ a £ M let 

Pa = r 1 (c r «). 

Then a(£) is generated by the sets P a , so it suffices to prove that for 
each aGl there exists some Q a G o~(F o £) such that jj(Q a A P a ) = 0. 
In fact we will put 

Q a = C l F~ l F(C a ) = (F o O'^Ca). 

Since F is non-decreasing F(C a J is a Borel subset of [0, 1], hence Q ast G 
a(F o £). So it remains to show that /Lt(Q a A P ) = for each o6R. 
First suppose = 0*. Then by (2) of Lemma 3.1 

Pa = Pa, = C\C a ,) M, ^F^FiCj = Q a , = Q a , 

hence Q a A P a = 0, and so n(Q a A P a ) = 0. 
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Now suppose a* < a. Then for Z = F~ 1 F(C a ) \ C a it holds 

Q a = r'F-'FiCa) = r\c a ) u r\z) = p a u r\z), 

Therefore, by (4) 

MQa A P a ) = ^(Q a \ P a ) = n{C\Z)) = 0. 
The Lemma is proved. D 

3.2. Ergodic properties. Let T : Q — > Q be a measurable map. 
Define the function 1^ : Q — > R by 

I d (u) = #{r = 1, . . . , d - 1 | £ o V(u) < £(w)}. 

So Jd(cj) is the number of points among the first d — 1 points of the 
T-orbit of w at which £ takes values not greater than £(u). 

Lemma 3.3. If T is ergodic and /^-preserving, then 
(11) F o £( w ) = a.e.lim ^^ 

d— s-oo a 

Proof. For each a G R consider the following set 

K a = £ _1 (-oo,a]. 

Then by definition 

F{a) = n{K a ) = //(w e fi | f (w) < a). 

Moreover, as T is ergodic, it follows from Birkhoff 's Ergodic Theorem 
that there exists a subset Q a G Q such that //(O a ) = 1, and for each 

a) G £l a 

fi(K a )= \\m-#{r<d\T r (u)eK a } 

= lim - #{r < d | £ o T r {u) < a}, 
d— >oo a 

Take any countable dense subset S C R containing all points of 
discontinuity of F and let 

n= f]n a . 

Then fi(£l) = 1 as well, and for each a G S and ui G f2 
/i(JC) = lim i #{r < d | £ o T r (u) < a}. 

d— >oo a 
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In particular, if u> G Q is such that a = £(w) G S, then 
F(£(w)) = F(o) = Ai(A.) = /*(ff« )) = 

lim 3 #{r < d | £ o T r (u/) < £(w)} = lim j 



d— >oo u d— >oo d 

Thus, {/d} converges to Fo^ on the set £ _1 (/S') flf2. We will prove that 
in fact this sequence converges to F o ( on O. 

Let u) G Q be such that a = f (a;) eE\S. Then F is continuous at 
a. 

Choose two sequences 

{bi} i&N c Sn(-oo,a), {ci}i & n C S C (a, +00) 

converging to a. Then by construction of Cl for each i G N we have 
that 

F(q) = ^(F 6i ) = lim \ #{r < d \ £ o T r (u) < &<}, 
F( Ci ) = fi(K Ci ) = lim \ #{r < d \ £ o T r (w) < c,}. 

d— >oo (X 

Since 6« < a < q, we see that 

#{r<d|^oT r (cD)<fe J } < J d (w) < #{r<d|e°T r (w)<c i }. 

Hence 

F(a) = lim F(6j) < lim I d (u) < ImT I d (u) < lim F(q) = F(a). 

Thus lim Jd(a)) exists and coincides with F(a) = F(£(u))), which 

d— >oo 

proves the lemma. D 

Corollary 3.4. Let (f2,F, /i) be a probability space and T : Q — y Q 
and 

be measurable maps. IfT is ergodic and ^-preserving, then 

a(Q) c X e ' T . 

Proof. Suppose n = 1, so 9 = ^ : O - ?• IR is a function. Then by 
Lemma 3.2 a(£) = cr(Fo£). Notice that Id is E^ ,T -i3([0, Immeasurable 
for each d and by Lemma 3.3 the sequence {Id} converges a.e. to 
Fo(. Hence F o £ is F-B([0, l])-measurable as well. This means that 

<r(0 = cr(F o £) C 5* T . 

If n > 2, then for each i = 1, . . . , n we have the inclusion of a- 
algebras: 
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Since S 0,T is generated by E^' T for alH = 1, . . . , n, we see that 0"(0) C 

£ 9 > T D 

Corollary 3.5. Let (Q, J 7 , fi) be a probability space, T : Q — > Q and 
= (£ 1; . . . , £ n ) : Q — >• M. n be measurable maps. If T is ergodic and 
^-preserving, then 

(12) a({0oT fc } fc >o)=£ e < T 

Proof. Since E e ' T C o"({0oT fc }fc> o ), see Lemma 2.4, it suffices to show 
that 

(13) a({0oT fc } fe >o)c£ e > T 

As in the proof of Corollary 3.4, we can restrict to the case n = 1 with 
= £ : Q — > M, because S 8 ' T is generated by S^' T , i = 1, . . . , n. 
We will show that 

(14) £« oTfc < T c £«' T , k>\. 
Then by Corollary 3.4 we get the inclusions 

which imply (13) with = £ : fi ->■ E. 

For the proof of (14) it is sufficient to show that partition V^ +1 is 
finer than V^ ' for all d > 1: 

7f T ' T -< T*£, d>l. 
Let 7r = (z , • • • , id) be a permutation of the set {0, . . . ,d} and P^ oT ' T 
be the corresponding element of partition "PJ° ' , so P^ ,T consists of 
all u G Q such that 

(oTof»H > (oTor(w) > ••■ > (oTop( w ), 

and if £ o T o 2^(w) =(oTo T i *+ 1 (u), then z r > z r+1 . 
In other words, u) G P| oT ' T if and only if 

(15) (oT 10+1 (w) > £oT h+1 (u) > ■■■ > (or +1 ( u ), 

and whenever £ o T lT+1 (u) = £ o T lT+1+1 (u;), then z T > z T+1 for r G 
{0,...,d-l}. 

Consider the following permutations of the set {0, . . . , d + 1}: 

a = (0, lo + l, i\ + 1, ..., id + 1), 
«i = («o + l, 0, z'i + 1, ..., id + 1), 

«d+i = (*o + 1, *i + 1, ■ ■ ■ , k + 1, 0), 



KOLMOGOROV-SINAI ENTROPY 15 

We claim that 
(16) P ?oT,T = P ? ' T UP ? ' T U---UP e,T . 

which will prove that the partition V\' +l is finer than V d ' . 

d+l 

Evidently, for all ui G |J P^ T condition (15) holds true, that is 

uo e P| oT - T . 

Conversely, let u G Pj oT ' T If £(w) > £ o r*° +1 (w), then u G Pj; T 
Otherwise, let r = max{6 G {0, . . . , d} \ £ o T tb+l (uo) > f(w)}. Then 
u> G Pj; T . This completes the proof of (13). D 

3.3. Proof of Theorem 2.5. Let (fi, J 7 , jx) be a probability space, T : 
Q — > Q be a measurable //-invariant transformation, and : fi — >■ M n 
be a measurable map such that ff({9or fc }j.>o) = J 7 . We have to prove 
that 

(it) K s m-^tLi H M p ^) 

if either 

(a) T is ergodic, or 

(b) T is not ergodic, however Q can be embedded into some compact 
metrizable space so that J 7 = 13 (CI). 

In the case (a) it follows from Corollary 3.5 and the assumptions above 
that 

which by Lemma 2.2 implies (17). 

In the case (b) the equality (17) follows from the Ergodic decompo- 
sition theorem by the arguments of the proof of [10, Theorem 2.1]. □ 

4. Residuality and prevalence 

4.1. The set of non-injectivity. Let : Q — > X be a continuous 
map between topological spaces fl and X. Suppose also that \i is a 
measure on the cx-algebra B(Q) of Borel sets of Q. In this section we 
give sufficient conditions on G for the equvalence <r(0) = B(Q) and 
also prove Theorem 2.13. 
The subset 

(18) N e = {ooen\&- 1 e(u)^{u}} 

of tt is called the set of non-injectivity of 0. It plays a principal role 
in the further considerations. 
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We will now present a more useful description of TVe- Given a set fl, 
a number s > 1, and map G : Q — > X into some set X put 

fl' = px-x(l , A(] s = {(u,... ) u)en>Gfi} 1 

s 

q s = 8 x ■ ■ ■ x e : n s -> x s , e s (a;i, . . . , w 8 ) = (e(wi), . . . , e(w,)). 

In particular, for s = 2 consider the following subset of f2 2 : 

(19) m = (e^-^Ax 2 ) \ An 2 = {( W) w')|w^u;',eH = e(w')}. 

Let also p : f2 2 — >• f2 be the projection to the first coordinate. Then it 
is evident that 

(20) N e =p{M). 

The following lemma describes some properties of the set of non-injectivity. 

Lemma 4.1. 1) Q- l Q(N e ) = N e . 

2) For any subset F C Q \ Nq the restriction Q\p : F — > X zs 
injective. 

3) Suppose Q and X are Hausdorff, Q is also second countable and 
locally compact (e.g. a manifold). Then Nq is an F a subset ofQ, and 
in particular Nq G B(Q). 

Proof. Statements 1) and 2) are evident. Let us prove 3). It is easy 
to see that a topological space X is Hausdorff iff the diagonal AX 2 is 
closed in X 2 . This implies that (G 2 ) -1 (AX 2 ) is closed in O 2 , hence 
M defined by (19) is second countable and locally compact as well. 

oo 

Therefore M = [J Mi where each Mj is compact. Hence 

«=i 



Nq= P (M)= P 1{JmA =\Jp(M i 



\A=1 I i=\ 



But each p{Mi) is compact and so closed in Q. Hence Nq is an F a - 

set. □ 

Recall that a Polish space is a second countable completely metriz- 
able topological space. 

Theorem 4.2. Let Q and X be Polish spaces, fi be a measure on 
B(Q), : Q — > X be a continuous map, and Nq be the set of its non- 
injectivity. Suppose Nq G B(Q) and /i(X e ) = 0. Then cr(6) = B(Q). 
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Proof. Since <r(B) C B(Q), it remains to consider the inverse inclusion. 
It suffices to show that for any open set G G B(Q) there exists some 
G G o-(6) such that //(G AG)=0. Given G, put 

G = G\N . 

Then by 2) of Lemma 4.1 the restriction 0|g : G — >■ 0(G) is one-to- 
one. So 6(G) is a one-to-one image of the Polish space G under the 
continuous map 0|g : G — >• X. This implies, [14, Theorem 15.1], that 
0(G) eB(X), whence 

G = 0- 1 (0(G)) G a(0). 

Therefore fi(G AG) = /x(G n N e ) < /i(iV©) = 0. D 

4.2. Multijets transversality theorem. The proof of Theorem 2.13 
is based on the so-called multijets transversality theorem, see [6, Chap- 
ter 2, Theorem 4.13]. We will formulate it below preserving the nota- 
tion from [6]. 

Let Q and X be smooth manifolds, dim Q = m, dim X = n, J k (Q, X) 
be the manifold of fc-jets of smooth maps : Q — > X, 

a: J k (tt,X) ^tt 

be the natural projection to the source, 

a s = ax ■■■ xa: J k {Q,X) s ^ Q s , 

J]W = {( Wlj . . . , u n ) G tt s | Ui ^ Uj for i^ j}, 
and 

Then J k (Q,X) is an open submanifold of J k (Q,X) s and we have the 
map 

j k e : n« -» J s fc (fi,x), ^©(^1, ■ ■ ■ ,0 = (i fc e(wi), . . .,j k eM). 

The following result is called multijets transversality theorem. 

Theorem 4.3. [6, Chapter 2, Theorem 4.13]. Let B be a submanifold 
in J k (Q,X). Endow C°°(fl,X) with the strong topology G|°. Then the 
set 

V B = {© G G°°(fi,X) | j k & is transversal to B} 
is residual in C°°(Q,X). If B is compact, then Vb is also open. D 
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We will apply this theorem to the case k = and s = 2. First we will 
show that description (20) of Nq is related to multijets transversality 
theorem. Recall that J°(Q,X) = fi x X. Then 

J 2 °(fi, X) = {(w, x, u', x')\lu^ u/} C J°(n, X) 2 = (Ox X) 2 . 

Let /3 : J$(tt,X) — > X 2 be the projection to the destination given by 

(3(uj,x,uj',x') = (x,x'), 

and 

(21) B = p-\AX 2 ) = {(u, x, w', x)\u^u'}. 

Evidently, /3 is a submersion. Therefore it is transversal to AX 2 , and 
so B is a submanifold in J 2 (fi, X) of codimension 

codim AX 2 = dimX 2 — dim AX 2 = dimX = n. 

Also notice that B is non-compact. Consider the map 

j° 2 e : n® -+ j 2 °(r2,x), j° 2 e(u,u') = (u;,eH,u/,e(u/)). 

Then 

m = (j°e)- x (B) = {(w,w') efi 2 1 u ± u', e(w) = e(w')}, n q = p (m), 

as in (19) and (20). 

Corollary 4.4. Lei I? be the submanifold of J 2 (f2,X) given by (21) 
and 

(22) V B = {© e C°°(fi,X) | j 2 °e zs transversal to B}. 

Then by Theorem 4.3 Vb is residual in C°°(f2,X) with respect to the 
strong topology CJ°. If m < n, then for each 9 6 Vs £/ie se£ X e has 
measure zero in the sense of Definition 2.11. 

Proof. Notice that B has codimension n in J 2 (f2,X). Therefore the 
submanifold M = (j 2 G)~ 1 (i?) has the same codimension n in £l( 2 ). 
Since m < n, we obtain that 

dim M = dim fi' 2 - 1 — n = 2m — n < m = dim f2. 

Consider the restriction p\m '■ M — > Q. As dimM < dimfi, each point 
of M is critical for p\m, whence by Sard's theorem, [6], the image of 
the set of critical points of p\m, i-e. the set p(M) = Nq, has measure 
zero in the sense of Definition 2.11. □ 

Corollary 4.5. Suppose in Corollary 4-4 X = W 1 for some n, so 
C°°(Q, ~R n ) is a linear space. Then the set Vb has a probe. In particular, 
by Lemmas 2.9 and 2.10 it is prevalent with respect to any of weak 
topologies C r w on C°°(n,M. n ). 
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Proof. First we introduce some notation and prove Lemma 4.6 below. 
Let M(n, k) be the space of (n x /c)-matrices (n rows and k columns) 
which can be identified with M. nk , and D r {n, k) be the subset of M(n, k) 
consisting of matrices of rank r. Then D r (n, k) is a smooth submanifold 
of codimension (n — r)(k — r), see e.g. [15, Lemma 1.19]. Define the 
map 

$ : M(n, k) x M(n, k) ->■ M(2n, k), 
which associate to each pair A, B & M(n, k) the matrix Q(A, B) ob- 
tained by appending all rows of B to A, see Figure 4.2. Evidently, $ 



A 
B 



Figure 1. Matrix $ (A, B) 

is a smooth diffeomorphism. 

Now we can construct the probe for Vb- Let G : Q — > M(n,k) be 
a map satisfying statement of Lemma 4.6. For each v G M. k define the 
following smooth map 

L v : n -+ M n , L w (w) = G(w)t;, 

and let 

P = {L„ | v E R k } C L7°°(fi,M n ). 
Then P is a linear subspace of C°°(Q, M n ) of dimension < k. We claim 
that P is a probe for Vb- 

Indeed, let 9 G C°°(r2,]R n ) be any map. For each Del' denote 

6^ = 6 + L v , 
so the translation of P by G is the following affine subspace of C°°(f2, R") 

q + p = {q v \ «Gi k }. 

We should prove that the following set: 

Q = {v G K | j%Q v is not transversal to B} 

has Lebesgue measure zero in M. k . Define the map 

tf : fi (2) x R k ->■ J 2 (fi,M n ) C (fi x M n ) 2 

by 

*(w,w',t;) :=i 2 °(e+L„)(o;,a; / ) = (w, e^+L^w), w', e(a; , )+L^ ) (a; , ))• 

Then the Jacobi matrix of \1/ at point (u,u',v) has the form shown in 
Figure 4.2, and so its rank is maximal and equals 2(m + n) due to the 
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m 


k 


Id 













G(w) 





Id 










G(W) 



Figure 2. Jacobi matrix of \& at point (u,u',v) 

choice of G. Hence \I/ is a submersion. Therefore it is transversal to B, 
and so M = ^ _1 (S) is a submanifold in fi (2) x R k . Let vr : M ->• R k be 
the restriction to M of the natural projection fl^ 2 ' xl fc 4 M. k . Then it 
is easy to see that Q coincides with the set of critical values of n. Since 
7r is smooth, we get from Sard's theorem that Q has Lebesgue measure 
zero, see e.g. [7, Chapter 2, §3]. Corollary 4.5 is completed. □ 

Lemma 4.6. If k > 2{m + n), then there exists a smooth map G : 
Q — > M(n, k) such that for any pair of distinct points u ^ u/ G Q the 
matrix 

$(G(w),G(w')) 

has rank 2n. 

Proof. The proof is also based on the multijets transversality theorem. 
Consider the following spaces: 

J°(fi, M(n, k)) = ttx M(n, k), 

J 2 °(fi, M(n, k)) = {(w, A, u', A')\u^ u'} c J°(n, M(n, k)f = (fi x M(n, k))' 

Let 

7 = $ o : J 2 °(fi, M(n, fc)) -A M(n, A;) 2 -^ M(2n, fc) 

be the projection to the destination (3 composed with the diffeomor- 
phism $: 

l(u,A,u/,A')=*(A,A'), 
and 

D r (2n,k) = -f-\D r (2n,k)) = {(u) , A, ou' , A') \ u ^ u/, rank$(A,A') = r}. 

for r < 2n. Since 7 is a submersion, it is transversal to D r (2n, k), and 
so D r (2n, k) is a submanifold in J 2 (Q, M(n, k)) of codimension 

codimD r (2n, k) = codimD r (2n, k) = (2n — r){k — r). 

Then by multijets transversality theorem the set 

T r = {G E C°°(n,R n ) I f 2 G is transversal to D r (2n, k)} 
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is residual. Hence, so is the intersection 

2n-l 

T = f| T r , 

r=0 

and, in particular, T is non-empty. We claim that any G G T satisfies 
the statement of the lemma. 

First notice that the assumption k > 2(m + n) is equivalent to the 
inequality: k — 2n + 1 > 2m. Then for < r < 2n — 1 we have that 

codim D r (2n, k) > codimD 2n _ 1 (2n,/i;) = k— 2n+l > 2m = dimfi^, 

and so transversality of j\G to D r (2n, k) means that J2G(£l^)nD r (2n, k) 
0. Thus if a map G : Q — > M. n belongs to T, then 

j°G(fi (2) ) n D r (2n, k) = 0, r = 0, 1, . . . , 2n - 1. 

This means that rank$(G(u;), G(u/)) = 2n for any u ^ u' E Q. D 

Proof of Theorem 2.13. Let f2 be a smooth manifold of dimension 
m, /i be a Lebesgue absolute continuous measure on £>(f2), T : Q — > Q 
be a measurable /i-invariant transformation, and n > m. 

Let V = V B be defined by (22). Then by Corollaries 4.4 and 4.5 V 
is residual with respect to the strong topology C^ and prevalent with 
respect to the weak topology C^. 

We claim that (9) holds for each 0G V. Indeed, by 3) of Lemma 4.1 
Nq is a Borel subset of Q. Also by Corollary 4.4 it has measure zero in 
the sense of Definition 2.11. Since \x is Lebesgue absolute continuous, 
we see that /i(iVe) = 0, whence by Theorem 4.2 cr(O) = B(Q). 

Furthermore, as Q is an m- dimensional manifold, it can be embedded 
in (2m + l)-cube being a compact metric space. Therefore by (b) of 
Theorem 2.5 we have that 



/^(T) = Jim hm \HJr k {Vf T ) 

^ a— >oo k— »oo K \ 



d-^toa k— >oo k 

This completes Theorem 2.13. □ 
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